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PREFACE 


The  Strategic  Air  Command  (SAC)  is  in  the  middle  of  the  largest  conceptual 
change  in  the  command's  history.  Beginning  in  1985,  the  command  has 
restructured  the  way  it  thinks  about  tactical  matters.  Driven  by  the 
increasing  Soviet  threat,  SAC  rewrote  its  tactical  doctrine  and  placed  greater 
demands  upon  its  aircrews  to  learn  new  information.  The  Inspector  General's 
(IG)  testing  system  is  a  blanket  approach,  not  reflecting  sound  educational 
testing  guidance.  Tests  remain  basically  the  same  in  form  and  content  as 
before  the  new  tactics  initiatives.  The  author's  purpose  is  to  examine  ways 
for  the  IG  to  improve  the  testing  process,  accurately  measure  aircrew 
knowledge,  and  assess  whether  the  crews  are  ready  to  perform  their  mission. 

The  author  will  examine  testing  history,  discuss  the  attributes  of  a  good 
examination,  examine  how  other  commands  and  services  test,  discuss  non-written 
evaluation  systems,  and,  finally,  make  recommendations.  -« - * 

During  this  project  Major  Mike  Gentry's  assitance  from  SAC  Headquarters 
was  instrumental  in  determining  command  testing  policy,  implementation 
feasibility,  and  insights  of  various  general  officers.  The  guidance, 
patience,  and  plain  honesty  of  Major  Steve  Hansen,  my  advisor,  is  what  kept 
this  paper  on  time  and  on  target. 
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Major  Dixon  received  his  Bachelor  of  Arts  Degree  in  Economics  from  the 
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rated  officer,  completing  navigator  training  in  1977  at  Mather  AFB, 

California,  and  pilot  training  in  1982  at  Columbus  AFB,  Mississippi. 

Major  Dixon's  operational  experience  is  extensive.  Upon  graduation  from 
navigator  training  and  completion  of  combat  crew  training  he  was  assigned  to 
F3- 111  bombers  at  Pease  AFB,  New  Hampshire.  Upgrading  to  instructor  radar 
navigator  while  still  a  first  lieutenant,  he  became  the  unit's  expert  on 
tactics  and  the  new  electronic  countermeasures  equipment  being  installed  in 
the  FB— 111.  He  participated  in  two  "Tiger  Meet"  tactical  flying  competitions 
in  NATO  before  his  selection  to  attend  pilot  training. 

In  August  of  1982,  he  was  an  Outstanding  Graduate  of  B-52  combat  crew 
training  at  Castle  AFB,  California.  Assigned  to  the  337th  Bombardment 
Squadron  at  Dyess  AFB,  Texas,  he  served  as  a  B-52H  copilot  and  the  unit's 
flying  safety  officer.  He  upgraded  to  aircraft  commander  in  the  minimum  time 
allowed  and  was  reassigned  to  Andersen  AF3,  Guam  to  fly  B-52Gs.  His 
additional  duties  at  Guam  included:  self  inspection  monitor,  OER  monitor  and 
chief  of  the  instrument  flying  school.  Major  Dixon  upgraded  to  instructor 
pilot  in' minimum  time,  returning  to  Guam  to  assist  in  developing  B-52  delivery- 
tactics' for  the  AGM-84  Harpoon  anti-ship  missile.  The  final  position  he  held 
before  his  assignment  to  ACSC  was  as  the  squadron's  chief  instructor  pilot. 

Major  Dixon  has  over  3100  hours  of  flying  time  including  500  hours  in  the 
FB- 111.  over  2000  hours  in  the  B-52  and  300  hours  in  the  T-37.  He  has  ten 
years  of  SAC  experience  and  participated  in  more  than  15  operational  readiness 
inspections.  He  is  a  graduate  of  SOS  and  ACSC  by  correspondence  and  has  an 
MBA  in  Management  from  Golden  Gate  University. 
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EXECUTIVE  SUMMARY 


Part  of  our  College  mission  is  distribution  of  the 
students’  problem  solving  products  to  DoD 
sponsors  and  other  interested  agencies  to 
enhance  insight  into  contemporary,  defense 
related  issues.  While  the  College  has  accepted  this 
product  as  meeting  academic  requirements  for 
graduation,  the  views  and  opinions  expressed  or 
implied  are  solely  those  of  the  author  and  should 
not  be  construed  as  carrying  official  sanction. 


REPORT  NUMBER  88-0755 
AUTHOR(S)  MAJOR  EDWARD  T.  DIXON,  USAF 

TITLE  IMPROVING  SAC'S  INSPECTOR  GENERAL  AIRCREW  TESTING  PROGRAM 


Purpose:  To  propose  improvements  to  Strategic  Air  Command's  (SAC's)  Inspector 
General  aircrew  testing  program  in  order  to  more  accurately  measure  aircrew 
tactical  knowledge,  and  the  aircrew's  capability  to  carry  out  wartime 
missions. 

Problem1  SAC  is  in  the  midst  of  a  major  tactics  revision  emphasizing  threat 
knowledge  and  flying  skills.  New  threat  systems  and  improved  enemy 
capabilities  are  expanding  aircrew  knowledge  requirements.  The  IG's  aircrew 
evaluation  system  has  not  kept  pace  with  the  tactics  revision  program,  and 
needs  to  be  improved  to  accurately  measure  expanding  aircrew  knowledge. 

Plgcuggjpm  While  he  was  Commander-In-Chief  of  SAC,  General  Larry  Welch 
directed  a  command  wide  tactics  improvement  program.  Facing  an  improved 
Soviet  fighter  threat  with  outdated  B-52  electronic  countermeasures  and  a  crew 
force  that  was  rapidly  losing  experience  through  through  retirement,  B-l 
manning,  upgrading  pilots  and  navigators  early  and  airline  hiring,  General 
Welch  felt  that  current  tactics  were  merely  procedural. 
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The  Operational  Readiness  Inspection  <0RI>  evaluates  SAC  aircrew's  ability 
to  perform  their  wartime  tasks.  The  ORI  does  not  yet  take  into  account  the 
new  tactics  training  program.  With  one  exception,  the  entire  ground  testing 
scheme  remains  unchanged.  Test  construction  guidance  in  AFM  50-62,  Handbook 
for  Air  Force  Instructors,  is  not  used.  Tests  are  written  using  guidance 
found  in  SAC  regulations  supporting  the  aircrew  standardization  program.  This 
restrictive  SAC  guidance  eliminates  many  types  of  questions  applicable  to  ORI 
testing  and  builds  guessing  bias  into  the  test.  The  inflight  portion  of  the 
ORI  does  not  evaluate  any  new  flying  train inng  events  created  through  the 
tactics  training  program. 

Our  sister  services  and  other  MAJCOMs  have  effective  ways  to  evaluate 
their  aircrews.  Aircrews  plan  missions,  drop  cargo  or  weapons,  are  questioned 
by  evaluators,  and  take  a  battery  of  tests  including  aircraft  recognition.  No 
one  organization  uses  the  simulator  in  evaluation. 


Written  tests  need  to  be  complemented  with  other  evaluation  tools. 
Aircrews  briefing  specific  wartime  sorties  to  an  IG  panel  perform  at  high 
cognitive  levels.  Planning  a  strike  mission  uses  tactical  skills  at  the  same 
high  cognitive  levels. 

Using  the  B-52  simulator  is  not  practical  because  some  units  have  to 
commute  to  one,  IG  evaluators  may  not  be  B-52  qualified,  and  the  simulator  is 
used  in  evaluating  tactical  knowledge  during  a  different  evaluation.  Having 
an  IG  representative  Informally  quiz  aircrews  repeats  what  aircrews  have 
demonstrated  in  formal  briefings  while  introducing  a  possible  grading  bias. 
These  two  evaluation  means  represent  redundant  evaluation. 


Conclusions:  The  new  evaluation  program  should  test  tactics  separately.  A 
separate  grading  area  for  tactical  knowledge  should  be  created.  The  tests 
given  to  aircrews  should  contain  many  selection  type  questions  and  include 
aircraft  recognition.  Tests  should  be  written  by  the  436th  Strategic  Training 
Squadron  <STS>,  the  unit  responsible  for  writing  all  tactics  training  lessons. 
Tactics  questions  would  b«  entered  into  a  master  question  data  base  for  ease 
in  updating  information  or  generating  tests  via  microcomputer. 

Non-written  evaluation  will  consist  of  two  formal  mission  briefings 
forming  20  percent  of  the  tactical  knowledge  grade.  One  aircrew  will  plan  a 
strike  mission  to  be  evaluated  tactically.  This  mission  plan  will  be  worth  10 
percent  of  the  tactical  knowledge  grade. 

The  IG  needs  to  evaluate  50  percent  of  the  aircraft  a  wing  flies  during  an 
ORI.  This  provides  a  comprehensive  look  at  the  aircrews  while  providing 
accurate  input  data  for  the  unit's  overall  IG  rating.  Increasing  Inflight 
evaluated  activities  challenges  aircrews  while  providing  a  more 
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realistic  comnat  simulation.  Reducing  radio  and  electronic  emissions,  flying 
at  night  and  evaluating  weapon  release  parameters  can  be  incorporated  into  the 
evaluation  immediately. 

Recsmmendat i ons :  SAC's  IG  testing  program  can  be  improved  by  improving 
the  quality  of  the  evaluations,  grading  tactics  as  a  separate  area,  and 
complimenting  the  test  with  formal  briefings  and  a  mission  planning  exercise. 
Increasing  the  number  of  evaluators  inflight  will  enable  SAC  to  gather  more 
accurate  data  to  compute  the  final  inspection  rating.  Increasing  the  numoer 
of  inflight  areas  evaluated  will  simulate  a  realistic  combat  environment  and 
provide  a  better  picture  of  the  aircrew's  capabilities.  The  author  recommends 
that  SAC  adopt  these  proposals. 
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Chapter  One 


BACKGROUND  FOR  CHANGE 


INTRODUCTION 

The  ability  to  apply  tactical  knowledge  automatically  In  an  unforgiving 
threat  environment  Is  the  key  to  survival  for  Strategic  Air  Command's  (SAC) 
aircrews  in  the  1990s.  Expanding  worldwide  US  commitments,  an  Increasing 
emphasis  on  contingency  operations,  and  innovative  new  missions  for  SAC's  B-52 
force  provide  new  challenges  for  aircrews. 

The  author's  purpose  Is  to  Investigate  ways  of  enhancing  SAC's  Inspector 
General  <IG)  aircrew  testing  process  to  more  accurately  measure  B-52  aircrew 
tactical  knowledge. 


BEmillONS 

Webster  defines  tactics  in  two  ways:  "The  art  or  skill  of  employing 
available  means  to  accomplish  an  end*,  or  "The  science  and  art  of  disposing 
and  maneuvering  forces  In  combat*  (3:1186).  JCS  Publication  1  likewise 
defines  It  in  two  ways:  "The  employment  of  units  in  combat*,  or  ’The  ordered 
arrangement  and  maneuver  of  units  In  relation  to  each  other  and/or  to  the 
enemy  In  order  to  utilize  their  full  potentialities"  (4:363).  The  author  uses 
these  definitions  to  shape  his  own  definition  of  tactical  knowledge  as 
knowledge  maximizing  your  capabilities  while  minimizing  those  of  your 
opponent . 

The  author  defines  the  evaluative  process  as  any  series  of  tests, 
written,  oral,  or  demonstrative,  administered  on  the  ground  or  Inflight, 
designed  to  measure  tactical  knowledge. 

Emergency  War  Order  (EWO)  knowlege  is  any  knowledge,  other  than  tactical 
knowledge,  a  B-52  crewmember  needs  to  carry  out  an  assigned  mission.  An 
example  of  EWO  knowledge  would  be  safe  passage  procedures. 


REASONS  FOR,  CHANCE 

Air  Force  Chief  of  Staff,  General  Larry  Welch,  when  serving  as 
Commander  in  Chief  of  SAC,  recognized  the  need  for  tactics  reform  by  calling 
the  current  tactics  manuals  "procedural",  and  told  SAC's  Director  of 
Operations,  "[Wei  need  to  create  much  better  understanding  of  threat 
capabilities  and  how  to  counter  [them!"  (21: — ). 


1 


General  Welch  was  also  concerned  about  the  increasing  Soviet  threat. 

During  the  early  1980s  the  Soviets  fielded  three  new  interceptors  with  a  true 
look  down,  shoot  down  capability.  In  the  1985-86  edition  of  Jane/s  A1 1  the 
World  s  Aircraft .  Donald  Latham,  Assistant  Secretary  of  Defense  for  C3I,  said 
of  the  MIG  31:  "  [It!  has  better  avionics,  a  better  C3  system  to  work  into,  a 
oetter  air  to  air  missile,  Is  faster,  has  greater  combat  range  and  ithe 
Soviets!  are  producing  it  like  gangbusters"  (2:53).  Aircrews  planning  to 
penetrate  Soviet  airspace  were  faced  with  greater  peril  than  at  any  other  time 
in  SAC's  history. 

The  bomber  crews  found  themselves  on  the  wrong  side  of  the  technological 
cycle.  When  a  major  new  threat  like  the  MIG  31  is  Introduced,  the  defense 
Industry  cannot  respond  and  upgrade  electronic  warfare  equipment  quickly. 
Soviet  systems  need  to  be  analyzed,  contracts  let,  and  defensive  systems 
designed,  tested,  and  Installed.  Until  new  equipment  becomes  available, 
increasing  aircrew  knowledge  and  developing  new  tactics  are  the  only  means  at 
SAC  s  disposal  to  attempt  to  counter  the  Soviet  threat. 

By  the  early  1980s,  bomber  tactics  were  outdated.  Chapter  7  of  SACR 
55-21.  Volume  II,  B-52  Aircrew  Tactical  Doctrine,  contained  little  threat 
specific  guidance  C 9 : Ch  7).  The  threat  guidance  provided  tried  to  catagorize 
every  situation  Into  a  universal  set  of  rules  to  use  In  defeating  a  family  of 
threats  (9:Ch  7).  In  the  five  years  the  author  worked  with  SACR  55-21,  Volume 
II,  there  were  no  major  tactics  revisions,  even  though  the  Soviets  were 
improving  their  defenses. 

Each  year  the  B-52  force  grows  younger  through  the  loss  of  experience. 
Navigators  upgrade  to  radar  navigator  In  400  hours  or  less  (8:Flg  2-1).  The 
3- IB  takes  only  highly  experienced  B-52  crewmembers  for  its  crew  force 
(13:4-6).  The  Advanced  Technology  Bomber  will  most  likely  require  the  same 
experience  levels.  Deregulation  brought  a  hiring  boom  in  the  airline  industry 
and  some  experienced  pilots  left  to  start  a  new  life.  The  core  of  the  Vietnam 
experience  Is  retiring,  leaving  SAC  with  few  beneath  the  rank  of  lieutenant 
colonel  having  actually  fired  a  shot  in  combat. 


OVERVIEW 

This  chapter  defined  tactics,  evaluation  systems,  and  discussed  why  SAC 
Initiated  changes  to  Its  tactics  program.  Chapter  Two  examines  the  history  of 
the  IG  s  testing  program  and  the  tools  used  to  evaluate  aircrews.  Chapter 
Three  discusses  how  evaluators  effectively  measure  learning  by  discussing 
knowledge  levels,  cognitive  theory,  and  test  design.  Chapter  Four  examines 
testing  programs  used  by  other  services  and  MAJCCMs.  Chapter  Five  examines 
non-wrltten  evaluation  tools,  such  as  oral  evaluations,  the  use  of  the 
simulator,  mission  planning  exercises,  and  Increasing  inflight  evaluation. 
Chapter  Six  proposes  the  author's  recommendations  for  Improvement. 


Chapter  Two 


A  HISTORY  OF  EVALUATION 


WRITTEN  EVALUATIONS 

SAC  IG  written  test  formats  are  the  same  now  as  when  this  author  entered 
the  command  in  1977.  Prior  to  the  introduction  of  SACR  3-1,  B-52  Aircraft 
Tactics,  aircrews  took,  a  situational  tape  test  to  measure  their  knowledge  of 
JCS  execution  procedures.  This  was  followed  by  an  eight  to  ten  question  test 
of  memory  Items  from  SACR  55-21,  Volume  II.  The  examination  concluded  with  a 
25  question  open-book,  examination  covering  ali  regulations  and  publications 
carried  1 nf 1 lght . 

The  Command  and  Control  Procedures  testing  remains  an  Important  part  of 
the  aircrew  testing  program  since  it  deals  with  nuclear  weapons.  This 
examination  is  required  by  SACR  55-45,  Volume  V,  as  a  portion  of  the  wing's 
nuclear  surety  evaluation  (10:9-1),  Allowing  individuals  to  take  the 
examination  as  a  crew  approximates  the  mission  environment.  Every  bomber 
crewmember  must  be  Intimately  familiar  with  command  and  control  procedures. 

It  is  critical  in  nuclear  surety  and  must  remain  in  any  future  testing  plan. 

Closed  book  testing  was  limited  to  critical  memory  Items  in  SACR  55-21, 
Volume  II.  The  test  guidance  for  this  examination  was  traditionally 
interpreted  by  aircrews  to  require  a  verbatim  response.  This  test  measured  an 
individual's  ability  to  memorize  large  amounts  of  material  instead  of  applying 
knowledge  to  a  specific  situation  or  carrying  an  answer  to  a  logical 
conclusion. 


The  open-book  test  required  snort  answer  responses  that  were  generally 
written  verbatim  from  the  source.  Answers  did  not  apply  knowledge  or  require 
a  developed,  'logical  conclusion.  Instead,  aircrews  wrote  down  the  response 
directiy  from  the  source  regulation.  This  test  measured  the  aircrews  ability 
to  find  25  answers  In  90  minutes  rather  than  measuring  how  aircrews  applied 
tactical  knowledge.  The  open-book  test  did  contain  some  demonstration  testing 
by  having  pilots  compute  aircraft  performance  problems  and  navigators  compute 
force  timing  and  deconf 1 Ictlon  problems. 


SACR  3-1  TESTING  CHANGES 

Publication  of  SAC  Regulation  3-1  changed  testing  only  slightly.  For 
three  months  there  was  a  moratorium  on  IG  testing  to  allow  aircrews  to 
familiarize  themselves  with  the  new  regulation  (19:1). 
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During  the  next  12  months  testing  remained  unchanged  (19:1-2),  allowing  SAC  to 
assess  question  validity  and  the  wings  to  train  the  aircrews.  After  12 
months,  the  entire  SACR  3-1  became  testable  on  a  closed-book  basis  (19:2). 

The  only  effective  change  made  was  Including  open-book  tactics  questions  in 
the  closed-book  section  of  the  examination  without  changing  any  test  format. 


Inflight  evaluation  evolves  continuously.  During  the  1970s,  few  flying 
areas  were  evaluated.  The  wing's  rating  was  based  on  the  proportion  of 
accurate  weapons  delivered  versus  total  weapons.  No  actual  weapons  were  ever 
dropped.  Scoring  was  done  by  radar  scoring  the  aircraft  position  in  relation 
to  the  target  and  applying  weapon  ballistics  to  the  aircraft  position. 

The  command's  damage  expectancy  (DE)  criteria,  today's  evaluation 
stancarc.  was  introduced  In  the  late  1970s  and  refined  In  the  early  1980s.  D: 
tries  to  measure  random  factors  impacting  aircrews  on  a  combat  mission,  such 
as  time  control,  equipment  performance,  and  navigation  accuracy.  DE  criteria 
also  significantly  reduced  the  allowable  weapon  miss  distance.  A  few  IG 
observers  fly  to  record  the  data  used  to  compute  the  DE  rating.  Most  DE  data 
comes  from  wing  operations  and  maintenance  reports. 


The  OR I  scenario  allows  for  up  to  three  aircrew  testing  sessions.  During 
two  CRTs  the  author  witnessed,  the  IG  brought  only  one  test.  The  first  crews 
took  the  test  and  debriefed  the  squadron  commander.  An  aircraft  commander 
meeting  followed  this  debriefing,  compromising  the  test.  The  IG  rating  for 
those  years  reflected  the  squadron's  information  distribution  effectiveness 
rather  than  aircrew  knowledge. 

SAC  considers  the  ORI  flight  to  be  just  another  training  mission. 

Peacetime  flying  and  safety  rules  apply.  There  is  no  enemy  trying  to  kill 
you.  Weapons  delivery  parameters  are  not  critical  and  electronic 
countermeasures  maneuvering  is  not  accomplished  to  insure  an  accurately  scored 
aircraft  position  for  bomb  scores.  The  author  believes  flying  the  ORI  mission 
is  not  like  flying  a  combat  mission. 


The  ORI  flying  mission  is  evaluated  according  to  a  set  of  criteria.  Not 
leaving  the  low  level  corridor,  receiving  10,000  pounds  of  fuel  from  the 
KC-135  tanker,  and  maintaining  mission  timing  within  two  minutes  are  examples 
of  criteria  objectives.  If  SAC  Is  to  keep  the  flying  phase 
criterion-related  and  not  result  oriented,  the  command  should  evaluate  more 
criteria  to  try  to  more  closely  measure  the  skills  required  for  combat. 


rhe  IG  s  evaluation  program  has  slowly  changed.  Simple  examinations 


still  require  rote  answers,  are  not  carried  to  logical  conclusions,  and  do  not 
relate  to  the  objectives  of  the  Individual  tactics  lessons.  The  changes  to 
the  testing  program,  associated  with  publishing  SACR  3-1,  simply  moved  one 
question  category  leaving  the  testing  format  unchanged.  Poor  evaluation 
scheduling,  with  several  testing  sessions,  can  enable  aircrews  to  compromise 
the  test.  Few  inflight  areas  are  evaluated  today  and  then  only  If  a  crew 
obtains  or  falls  to  obtain  a  very  specific  criterion. 


Chapter  Three 


4S 


& 


S3 


TECHNICALITIES  OF 
TEST  CONSTRUCTION 


Webster  defines  learning  as  the  ability  "to  acquire  a  skill,  knowledge  or 
a  behavioral  tendency"  <3:654),  The  Air  Force  student-centered  instructional 
system  reflects  this  definition.  Student-centered  instruction  "describe(s) 


learning  in  terms  of  outcomes  rather  than  instructor  activity"  (5:3-1). 


learning  has  been  accomplished,  the  student  wl 
knowledge  through  a  test. 


be  able  to  demonstrate 


The  Air  Force  feels  "learning  is  best  explained  by  one  or  some  combination 
of  two  theories,  behaviorism  or  cognitive  theory"  (5:2-1).  Behaviorists 
believe  that  people  learn  by  having  behavior  reinforced  (5:2-1),  while 
cognitive  theorists  see  motivation,  generalizing,  insight,  and  discovery  as 
significant  concepts  (5:2-1).  Cognitive  theory  requires  students  to  go  beyond 
simple  recall  and  gain  an  understanding  of  the  subject  (5:2-1).  Dr.  Benjamin 
Blooms  cognitive  domain  relates  given  learning  levels  with  appropriate  mental 
activities.  The  Air  Force  uses  Dr.  Bloom's  dorr.iin  to  develop  learning 
objectives. 


Bloom's  taxonomy  is  reproduced  in  Table  1.  Evaluation  represents  the  most 
complex  cognitive  behavior.  Learning  and  mental  activity  become  less  intense 
down  to  knowledge,  the  least  complex  level.  Instructors  use  cognitive  domain 
to  specify  behaviors  (objectives)  the  student  must  demonstrate  before  an 
evaluator  can  accept  learning  has  occurred. 


In  the  Air  Force,  "our  primary  reason  for  evaluation  Is  usually  to 


determine  whether  students  have  achieved  our  stated  objectives"  (5:20-5).  Air 
Force  tests  perform  other  functions  beside  measuring  learning.  Staff  officers 
use  test  results  to  validate  the  basic  assumptions  the  tactics  training 
program  is  based  on,  or  provide  feedback  to  revise  the  tactics  curriculum 
(1:3).  The  IG  can  use  test  results  to  evaluate  the  efficiency  of  a  wing's 


Instructor  force  or  stimulate  aircrews  to  learn  new  material  (1:6-7). 


Because  IG  test  results  are  Important  for  other  Inputs  to  the  tactics 
program  besides  a  wing's  IG  rating,  the  author  feels  SAC  needs  to  construct  a 
technically  accurate  exmalnatlon,  using  the  guidance  in  AFM  50-62.  to 
guarantee  accurate  results. 
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Evaluation 

Exercise  learned 

judgement 

Synthesis 

Create  new 

relationships 

Analysis 

Determine 

relationships 

.  Application 

Use 

general izations 

1 

in  specific 

instances 

Comprehension 

Translate,  interpret 

Knowledge 

Recall  and  recognition 

Table  1.  Cognitive  Domain 


AFM  50-62  describes  the  characteristics  making  up  a  good  test.  A 
technically  correct  test  takes  into  account  reliability,  validity, 
objectivity ,  comprehensiveness,  and  must  be  capable  of  differentiating 
(5:20-2).  Reliability  means  the  test  yields  consistent  results  each  time  it 
is  administered  (5:20-2).  A  valid  test  measures  exactly  what  it  is  supposed 
to  measure  (5:20-3).  An  objective  test  is  able  to  eliminate  the  bias  of  the 
grader  (5:20-4).  Comprehensiveness  means  to  take  a  liberal  sample  (5:20-4). 

The  IG  must  differentiate  between  individual  aircrew  members  or  compare  an 
aircrews  performance  to  lesson  objectives.  There  are  two  ways  to  do  this. 
Norm  referenced  differentiation  compares  individuals  to  each  other  (5:20-4), 
while  criterion-referenced  differentiation  compares  each  aircrew  against  a 
desired  outcome  or  set  of  standards  (5:20-5).  The  SAC  IG  uses 
criterion-referenced  differentiation,  comparing  aircrews  to  the  objectives  cf 
the  tactics  training  program. 


AFM  50-62  discusses  two  examination  types.  Selection  tests  use  multiple 
choice,  matching,  and  true  or  false  questions,  while  supply  tests  use 
completion,  short  answer,  or  essay  questions.  Both  types  of  questions  are 
app! icable  to  IG  testing. 


Selection  tests  offer  three  advantages  to  evaluators.  They  are  easy  to 
grade,  statistically  significant,  and  allow  the  evaluator  to  ask  many 
questions  In  a  short  time  period  <5:21-1).  Selection  tests  work  well  at  low 
cognitive  levels.  The  main  disadvantage  with  selection  tests  is  crewmembers 
can  guess  answers  with  a  reasonable  chance  of  being  correct,  especially  if  one 
or  two  false  answers  are  eliminated  (5:21-1). 

SAC's  test  development  guidance,  SACR  50-6,  builds  guessing  bias  Into 
tests.  Though  primarily  a  standardization  regulation,  SACR  50-6  is  familiar 
to  the  officers  at  SAC  Headquarters  writing  tactics  tests.  When  questioned 
about  the  guidance  action  officers  use  to  write  tests,  the  responsible  office 
at  SAC  Headquarters  replied,  "we  generally  follow  C SACR ]  60-4."  SACR  60-4  is 
the  primary  standardization  regulation,  familiar  to  aircrew  Instructors.  If 
an  action  officer  uses  this  familiar  regulation  Instead  of  AFM  50-62,  It  is 
logical  to  assume  these  officers  also  use  SACR  50-6  to  construct  test 
questions. 

SACR  50-6  states,  "Each  question  will  contain  exactly  four  alternatives" 
(7:4-1).  "One  alternate  (dlstractor)  should  represent  a  plausible  answer  only 
to  a  person  with  a  vague  knowledge  of  the  subject"  (7:4-1).  "One  alternative 
(distractor)  must  be  entirely  incorrect"  (7:4-1).  A  crewmember  with  a  vague 
knowledge  of  the  subject  can  eliminate  half  of  the  possible  answers  and  have  a 
50  percent  chance  of  guessing  the  correct  answer.  Using  true  or  false  test 
questions  does  not  eliminate  guessing  bias.  Aircrews  still  have  a  50  precent 
chance  of  correctly  guessing  the  answer  because  there  are  only  two  possible 
choices. 

One  alternative  Is  to  use  matching  questions.  Matching  questions  are 
useful  in  measuring  understanding  of  closely  related  concepts  or  facts 
(5:21-5).  The  questions  are  easily  graded,  provide  rapid  feedback,  and  allow 
the  IG  to  ask  many  questions  in  a  limited  amount  of  time. 

Supply  questions  can  be  used  to  question  aircrews.  Essay  questions  are 
used  when  students  are  required  to  think  reflectively  or  creatively  (5:21-12). 
implying  a  high  cognitive  level.  Essay  questions  are  difficult  to  score 
because  the  grader  needs  tactical  expertise  and  a  complete  answer  key.  Only  a 
small  number  of  essay  questions  can  be  asked  during  the  examination  period. 

The  short  answer  question  Includes  features  of  both  the  completion  and  the 
essay  Item  (5:21-11),  and  is  used  to  measure  the  ability  to  recall  facts, 
basic  concepts,  and  principles"  (5:21-11).  This  type  of  question  tests  ideas 
more  fully  then  selection  questions  since  the  recalled  idea  must  be  stated  in 
complete  form  (5:21-11).  It  too  needs  a  complete  answer  key  and  a 
knowledgeable  grader.  Completion  Items  almost  eliminate  guessing  (5:21-9), 
and  when  compared  to  essay  questions,  the  evaluator  can  ask  more  questions  in 
a  given  examination  period. 

Completion  items  work  well  at  lower  cognitive  levels.  An  evaluator  Is 
able  to  ask  many  questions  and  grade  them  quickly  with  a  simple  answer  key. 
These  questions  eliminate  aircrew  guessing  by  providing  no  possible  choices, 
only  a  blank  to  write  the  answer  in.  Completion  questions  present  fewer 
challenges  to  the  IG  than  other  types  of  supply  questions. 
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There  are  challenges  associated  with  using  essay  and  short  answer  tests. 
The  majority  of  answers  on  essay  tests  may  not  answer  the  question  fully  but 
demonstrate  some  subject  knowledge.  If  partial  credit  Is  given  the  evaluator 
must  give  credit  without  sparking  lengthy  debates  between  the  grader  and  the 
wing.  Even  with  a  knowledgeable  grader  and  a  complete  grading  guide,  essay 
grades  remain  subjective,  taking  a  long  time  to  evaluate  because  each  answer 
has  to  be  read  and  compared  to  the  grading  guide.  An  evaluator  can 
subconsciously  introduce  bias  by  evaluating  writing  style  or  penmanship 
Instead  of  tactical  knowledge. 


f- 
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This  chapter  defined  learning  and  discussed  using  the  cognitive  domain  to 
quantify  mental  activities  into  learning  objectives.  Crewmembers  demonstrate 
learning  by  responding  to  cr I  ter  la-referenced  examinations.  The  author 
examined  characteristics  of  good  evaluations,  types  of  test  questions 
described  by  AFM  50-62,  the  advantages  and  disadvantages  associated  with 
different  test  questions,  and  barriers  placed  on  effective  testing  by  staff 
officers  using  familiar  regulations  and  instructor  experience. 


Chapter  Four 


HOW  OTHERS  EVALUATE 


US.  Army 

The  Army  tests  each  pilot  during  his  annual  flight  evaluation.  Each  Army 
unit's  evaluation  pilots  develop  locally  administered  tests  from  a  centra! 
question  data  base  maintained  by  the  Fort  Rucker  aviation  school.  The  test 
consists  of  mulltple  choice  questions  dealing  with  aircraft  systems. 
Instrument  flying,  emergency  procedures,  tactics,  and  aircraft  recognition. 
Passing  Is  80  percent. 

During  the  ORI,  units  deploy  into  the  field  to  demonstrate  wartime 
capabilities.  Highly  qualified  pilots  from  Fort  Rucker  evaluate  helicopter 
crew  knowledge  through  informal  oral  questioning  dealing  with  any  helicopter 
subject.  There  are  no  written  tests  or  simulator  evaluations  during  the  ORI 
phase 


•  US.,  to 

The  Navy  uses  multiple  choice,  fill  in  the  blank  or,  short  answer 
ques* lens  with  all  squadron  personnel  taking  the  same  test  at  the  same  time. 
The  r?;"rity  of  test  questions  deal  with  tactical  applications,  and  aircraft 
recognition.  During  the  inspection,  the  air  wing  is  tasked  to  plan  a  strike 
miss. on  graded  on  terrain  use,  force  composition,  and  tactical  consiaerat Ions 
based  on  the  threat.  The  shore  based  simulator  Is  not  used  because  the  unit 
is  evaluated  at  sea.  Evaluators  informally  question  flight  crews  during 
mission  briefings  and  debriefings.  Evaluator  pilots  can  fly  the  wingman 
position  to  evaluate  an  individual's  flying  proficiency.  The  Navy  evaluators 
are  highly  knowledgable  in  tactics,  tactical  applications,  and  aircraft  flown 
by  the  unit  <  16:  — ) . 


MAC 


MAC  headquarters  writes  a  40  question,  multiple  choice  test,  dealing  with 
tactics,  aircraft  systems,  and  performance  data.  Passing  is  85  percent.  The 
simulator  is  not  used  in  evaluating  tactics.  Evaluators  Informally  question 
40-50  percent  of  the  aircrews  flying  an  ORI  mission  during  mission  briefing 


or  debriefing  asking  questions  from  any  area  graded  during  an  annual  flight 
evaluation  as  well  as  tactics  <17: — ). 


TAG.  USAFE.  and  PACAF 

TAC/AAC/USAFE/PACAF  Regulation  60-2,  Volume  I,  contains  guidance  for 
aircrew  testing.  This  regulation  establishes  the  command  master  question 
bank,  a  question  data  base  used  to  generate  tests  (14:5-1).  The 
TAC/'USAFE/'PACAF  IGs  test  aircraft  system  knowledge,  aircraft  recognition, 
tactical  knowledge,  and  technical  order  critical  procedures.  Passing  score  is 
85  percent  (14:5-3)  except  critical  procedures  that  require  a  perfect  score 
(14:5-3).  Of  50  questions,  at  least  half  are  devoted  to  tactics.  The 
evaluators  are  augmented  by  evaluator  pilots  and  intelligence  officers  from 
Numbered  Air  Force  Headquarters.  The  simulator  is  not  used  in  any  phase  of 
evaluation. 

The  majority  of  the  evaluation  occurs  during  the  inflight  phase.  Aircrews 
are  informally  questioned  when  an  evaluator  files  with  pilots  or  in  their 
formations.  The  IG  evaluator  grades  inflight  threat  detection  and  reaction 
from  chase  planes  or  the  fighter's  second  seat.  Tactical  evaluators  task 
other  fighter  units  to  perform  aggressor  Interceptor  duties,  attacking 
evaluated  fighters  proceeding  to  the  bombing  range.  The  IG  uses  gun  cameras 
and  voice  recorders  to  score  these  interceptions  and  actual  weapon  releases  to 
grade  weapon  reliability  (15: — ). 


SUMMARY 


Our  sister  services  and  MAJCOMs  possess  testing  vehicles  applicable  to  the 
SAC  evaluation  process.  Each  headquarters,  except  MAC,  tests  aircraft 
recognition.  No  one  uses  the  aircraft  simulator  and  tests  contain  many 
selection  questions.  The  Navy  and  MAC  use  mission  planning  exercises  to 
measure  the  ability  to  apply  tactical  knowledge.  All  evaluators  informally 
question  the  aircrew  they  fly  the  ORI  mission  with.  The  evaluators  are  highly 
competent  in  the  material  they  will  evaluate.  The  tactical  forces  emphasize 
inflight  mission  performance.  SAC  can  use  some  of  these  testing  vehicles  to 
improve  the  command's  IG  testing  program. 


Chapter  Five 


NON-WRITTEN  EVALUATION 


FORMAL  -ORAL.  EVALUATION 

The  mission  certification  is  SAC's  formal  oral  evaluation.  The  aircrew 
Driefs  a  specific  bomber  mission  to  a  panel  comprised  of  a  colonel  and 
representatives  of  the  wing's  mission  support  agencies.  The  briefing  lasts 
for  approximately  two  hours,  with  one  hour  for  the  aircrew  briefing  and  an 
additional  hour  for  the  staff  officers  to  question  the  aircrew  to  cover 
emitted  Information  and  re-emphasize  important  points.  The  certification 
forces  aircrews  to  operate  at  higher  cognitive  levels  by  applying  their  basic 
knowledge  to  sortie  specific  challenges.  The  certification  eliminates 
guessing  while  allowing  the  IG  to  determine  if  aircrews  are  meeting  the 
objectives  of  the  tactics  program  specified  in  SACR  3-1,  Volume  II. 

The  IG  faces  challenges  in  administering  a  certification  program.  The  IG 
must  anticipate  the  wing  volunteering  only  the  best  aircrews  to  brief,  forcing 
the  IG  to  randomly  select  certifying  aircrews  to  Insure  an  aircrew  cross 
section  is  evaluated.'  Bringing  together  the  large  number  of  People  required 
for  a  certification  may  create  physical  space  problems.  At  a  certification, 

In  addition  to  the  IG  representatives,  the  wing  staff  will  want  to  be 
represented.  There  are  very  few  work  areas  on  a  base  meeting  the  security- 
criteria  required  for  the  briefing.  In  the  author's  experience,  only  the 
briefing  room  at  the  war  plans  center  will  be  available.  Requiring  only  one 
briefing  assumes  a  small  sample  size  to  be  representative  of  the  wing  while 
eliminating  most  space  constraints.  Requiring  more  than  one  briefing  gives  a 
oetter  indication  of  aircrew  abllty  but  may  turn  the  certification  process 
into  an  ail  day  affair  because  of  space  and  IG  personnel  limitations.  The  IG 
may  not  have  the  time  or  evaluators  available  to  conduct  certifications.  In 
the  last  two  OPIs  the  author  witnessed,  no  mission  certifications  were 
administered. 

This  author  believes  certifications  are  an  important  part  of  the  overall 
evaluation  process.  It  allows  the  aircrews  to  translate  book  knowledge  into 
concepts  and  relate  those  concepts  to  real  world  challenges.  Aircrews  are 
challenged  to  provide  an  oral  essay  answer  to  a  panel  of  experts,  eliminating 
the  time  and  grade  keys  required  for  a  written  essay  test.  The  certification 
program  is  already  In  existence,  and  needs  only  to  be  employed  during  every 
evaluation.  The  challenges  in  Implementing  this  already  in-place  program  are 
administrative  and  could  be  easily  overcome  by  prior  planning. 


ihe  means  to  evaluate  aircrew  mission  planning  activities  exists  in  SAC's 
IG  system.  Tasking  a  bomber  crew  to  replan  a  sortie  is  done  on  a  selective 
basis,  depending  on  a  wing's  tasklngs.  Bomber  crews  must  be  capable  of 
plotting  target  positions,  air  refueling  routes,  and  ingress  and  egress 
routes,  taking  Into  account  the  tactical  environment.  The  aircrew  assembles 
the  administrative  paperwork  to  support  their  mission  planning  and  submits  the 
entire  package  to  the  IG  for  evaluation. 

The  aircrew  Is  operating  at  a  high  cognitive  level  by  applying  knowledge 
level  concepts  to  the  problem.  This  mission  planning  exercise  could  be 
administered  to  each  wing.  A  tactically  qualified  Individual  will  evaluate 
the  aircrew's  product  along  with  the  agencies  currently  tasked  to  evaluate  the 
plan. 


Using  the  weapons  system  trainer  (VST)  seems  to  provide  an  excellent 
opportunity  for  the  IG  to  observe  aircrews  perform  maneuvers  and  react  to 
threats  in  a  manner  precluded  by  peacetime  flying  safety.  The  aircrews  are 
performing  at  a  high  cognitive  level.  The  IG  could  develop  a  selection  of 
maneuvers  to  evaluate  each  aircrew,  quantify  aircrew  performance  into  a  grade, 
and  issue  a  report. 

This  author  believes  the  WST  does  not  have  a  place  in  IG  evaluations  of 
aircrew  tactical  knowledge.  SACR  51-52  states  the  purpose  of  the  WST  is  "to 
practice  tactics  and  malfunction/emergency  procedures"  It  does  not  address 
using  WSTs  for  evaluation  <8:7-1).  Every  base  does  not  have  a  WST  forcing 
some  wings  to  commute  aircrews  to  a  WST  site  during  an  intense  period  of 
evaluation.  IG  evaluators  may  not  be  current  or  qualified  in  the  B-52,  or 
have  little  or  no  evaluation  experience.  The  author  believes  the  best  choice 
for  evaluators  would  be  the  command  level  evaluators,  1st  Combat  Evaluation 
Group  (CEVG).  The  members  of  CEVG  possess  the  evaluative  skills,  are  the  oest 
aircrews  SAC  has,  and  are  current  in  B-52  operations. 

CEVG  and  the  WST  are  already  Involved  in  evaluating  the  tactics  program. 
SAC?  60-4,  Volume  I,  tasks  CEVG  to  standardize  SAC's  tactics  (11:11-1).  CEVG 
visits  each  wing  approximately  every  24  months  (11:11-1)  to  provide 
Instruction  to  the  wing's  aircrews  (11:11-1)  using  the  WST  (11:11-1).  Though 
not  a  formal  inspection  (11:11-1),  CEVG  debriefs  squadron  commanders  about 
unit  strengths  and  weaknesses.  Because  the  WST  is  already  used  in  the  overall 
evaluation  of  the  tactics  program,  the  author  believes  it  is  redundant  to 
evaluate  a  wing's  aircrews  in  the  WST  during  the  ORI. 


Other  commands  use  Informal  oral  evaluations  extensively  in  the  flying 
evaluation  phase.  Informal  oral  evaluations  allow  aircrews  to  operate  at 


higher  cognitive  levels.  The  crewmember  being  questioned  cannot  guess.  The 
IG  does  not  need  to  gather  a  large  group  of  evaluators  together  as  in  the 
formal  briefing.  The  rating  associated  with  this  questioning  is  hard  to 
quantify  and  subject  to  evaluator  bias. 


If  the  IG  accepts  formal  oral  evaluation  results  as  evidence  of  aircrews 
meeting  training  objectives,  then  requiring  informal  oral  evaluations  only 
re-evaluates  aircrew  ability  to  apply  basic  tactical  knowledge.  Unlike  a 
formal  oral  evaluation,  there  is  no  mechanism  in  place  to  conduct  this  type  of 
interview,  and  a  single  evaluator  Instead  of  a  panel.  Introduces  possible 
evaluator  bias.  Because  of  the  subjective  nature  of  the  rating,  possible 
questioning  of  evaluator  judgement  in  awarding  ratings,  the  need  for  complete 
grading  guides,  and  In  place  formal  oral  evaluations,  the  author  believes 
informal  ora!  evaluations  should  be  limited  to  questions  clarifying  inflight 
events  ana  data  recording  by  the  IG. 


INFLTGH1 


The  aircrew  flying  a  3-52  is  operating  at  the  evaluation  cognitve  level, 
"exercise! ing]  learned  judgement"  (5:2-2).  There  is  no  guess  work  as  the  crew 
translates  what  they  know  into  action.  Flying  the  B-52  is  the  ultimate  test 
of  an  aircrew's  capability  to  perform  a  mission  simulating  their  Emergency  War 
Order  sortie.  The  author  feels  SAC  can  place  greater  emphasis  on  inflight 
evaluation. 
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t  enough  evaluators  fly  with  the  aircrews  during  CRI  missions.  In  tr 
s  experience,  usually  two  members  of  the  IG  team  fly  with  aircrews 
the  CRI  flying  phase.  These  evaluators  fill  out  data  sheets  used  ir 
ing  the  DE  grade.  Using  two  evaluators  does  not  provide  a  comprehend 
at  ion  of  the  wing  s  aircrew  and  aircraft.  Some  discrepancies  applies 
culating  the  DE  rating  do  net  get  reported.  Low  numbers  of  evaluate: 
aircrews  and  wings  to  "game"  the  DE  system  by  not  powering  certain 
ft  systems  that  lose  points  upon  fai’ing  or  by  not  writing  malfunctic 
the  aircraft  records  that  are  checked  by  the  IG  for  information  tc 
ate  carnage  expectancy. 


This  author  believes  enough  knowledgeable  individuals  should  oe  assigned 
to  the  IG  team  to  Increase  the  inflight  evaluation  rate  to  5C  percent  cf  the 
sorties  a  wing  flies.  This  will  provide  a  comprehensive  lock  at  aircrew 
ability,  discourage  gaming  the  evaluation  system,  provide  accurate  feecbacx  on 
systems  capabilities,  and  provide  an  unlnflated  DE  rating. 

SAC  s  IG  team  should  Increase  its  manning  rather  than  augmenting  the  IG 
team  with  officers  from  the  headquarters  tactics  staff.  Using  tactics 
officers  as  augmentees  detracts  from  their  primary  job  of  managing  SAC's 
tactics  initiatives.  Adopting  the  author's  recommendation  will  require 
creation  of  additional  manpower  allocations  allowing  headquarters  staff 
officers  to  fly. 

There  are  more  activities  the  IG  can  evaluate  Inflight  to  measure 
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the  ability  to  right.  Actually  releasing  Inert  weapons  is  Being  studied 
By  the  SAC  staff  and  will  add  a  great  deal  of  realism  to  evaluations. 
Decreasing  allowed  communications,  flying  at  night  as  much  as  posslBle, 
and  grading  weapon  release  parameters  are  three  areas  that  could  Be 
Integrated  immediately  into  the  current  evaluation  system  with  little 
di  f f icul ty . 


The  author  Believes  formal  oral  evaluation,  mission  planning 
activities,  increasing  the  numBer  of  sorties  carrying  IG  evaluators,  and 
challenging  aircrews  through  increased  inflight  evaluation  will  allow 
SAC  to  Better  evaluate  aircrew  abilities.  Aircrews  operate  at  high 
cognitive  levels,  guessing  is  eliminated,  and  the  means  to  implement 
these  programs  is  already  in  place  in  the  evaluation  system.  The  author 
feels  informal  oral  evaluation  and  using  the  simulator  should  not  Be 
used  Because  they  are  redundant,  are  not  in  place  in  the  current 
evaluation  system,  and  could  Be  subject  to  evaluator  Bias  Because  of  a. 
single  evaluator. 


Chapter  Six 


SOLUTIONS  AND  RECOMMENDATIONS 


ZESTS 

The  author  believes  SAC  must  test  tactics  separately  from  EWO  knowledge. 
Tactics  and  EWO  knowledge  are  not  the  same  thing  although  historically  SAC 
treated  tactics  as  a  segment  of  EWO  knowledge.  The  changes  to  the  testing 
program  brought  by  the  publication  of  SACK  3-1  did  not  separate  or  increase 
the  number  of  tactics  questions.  Those  questions  were  merely  shifted  to  a 
different  examination  phase.  A  separate  tactics  test  allows  evaluators  to 
Incorporate  the  effective  test  characteristics  the  author  discussed  in  Chapter 
Three. 

Separate  tests  measure  exactly  what  SAC  desires  to  measure,  either 
tactical  knowledge  or  EWO  knowledge.  A  separate  tactics  examination  of  25 
questions  allows  for  a  more  comprehensive  sample  than  the  six  tactics 
questions  in  today's  examinations  (12:10-74).  The  six  tactics  questions  in 
‘he  EWO  knowledge  test  could  be  converted  to  EWO  knowledge  questons,  improving 
the  comprehensiveness  of  that  examination  without  lengthening  it. 

A  new  grading  area,  "tactical  knowledge",  needs  to  be  created  to  reflect 
the  results  of  the  separate  testing  program,  emphasise  the  Importance  of 
tactics,  and  provide  an  area  where  other  tactical  grading  results  could  be 
summarized.  The  author  sees  tactical  knowledge  as  a  grading  area  of  equal 
stature  with  the  current  "aircrew  knowledge"  rating. 

A  technically  correct  test,  written  by  SAC's  academic  experts,  using  the 
criteria  in  AFM  50-62,  will  provide  the  best  test  results.  Test  questions 
must  be  referenced  to  tactics  lesson's  learning  criteria.  Multiple  choice, 
matching,  or  completion  questions  should  be  used  because  they  relate 
cognitively  to  the  knowledge  level  objectives  of  the  tactics  program  as  well 
as  allowing  evaluators  to  ask  many  questions  in  a  short  time. 

SAC  should  create  a  command  master  question  bank  for  tactics  questions. 
This  data  base  can  be  updated  insuring  current  test  questions  reflecting  the 
latest  Soviet  capabilities.  Once  created,  tests  do  not  repeatedly  have  to  be 
written.  Coupled  with  a  random  question  generating  program,  the  IG  can  create 
any  number  of  different  tests  reducing  the  probability  of  a  single  test 
compromise. 


The  author  feels  the  436th  Stateglc  Training  Squadron  <STS>  Is  best  suited 
to  create  the  master  question  bank.  As  the  authors  of  all  SAC  ground  training 
lessons,  the  436th  STS  Is  familiar  with  the  objectives  of  each  lesson  In  the 
tactics  program.  As  the  436th  STS  develops  lessons  It  would  write  test  Items, 
enter  the  questions  Into  a  data  base,  review  the  data  base  for  technical 
accuracy,  and  forward  it  to  the  16.  Having  professional  lesson  developers 
write  tactics  tests  releases  SAC  tactics  action  officers  from  this  additional 
duty  allowing  them  to  concentrate  on  their  primary  Job  of  staffing  tactics 
Initiatives. 

The  ability  to  tell  friend  from  foe  Is  important  In  combat.  Testing 
aircraft  recognition  further  challenges  aircrews  while  insuring  they  can 
recognize  threats.  Five  35mm  slides  could  be  shown  to  aircrews  who  must 
Identify  the  threat  using  NATO  code-names.  These  slides  should  provide  an 
aircraft  picture  easy  to  Identify  without  being  obvious.  Testing  everyone 
encourages  each  crewmember  to  be  familiar  with  the  threat,  threat 
capabilities,  and  bomber  defensive  actions. 


NON-WRITTEN  EVALUATION 

The  author  recommends  certifying  two  aircrews  in  each  wing.  Two  crews 
provide  a  more  comprehensive  sample  but  must  take  Into  account  the  facilities 
limitations  discussed  In  Chapter  Five.  The  certifications  would  be  worth  20 
percent  of  the  new  tactical  knowledge  grading  area. 

The  author  further  recommends  the  16  choose  an  aircrew  to  replan  a  bomber 
sortie  during  each  Inspection.  After  the  plan  Is  complete  It  would  be 
evaluated  using  both  tactical  and  existing  criteria.  The  rating  worth  10 
percent  of  the  new  tactical  knowledge  grading  area  would  be  awarded.  A  crew 
certifying  a  mission  would  not  be  allowed  to  conduct  the  mission  planning, 
enabling  the  16  to  evaluate  more  aircrews. 


INFLI6HT  EVALUATION 

Increasing  the  number  of  inflight  evaluators  contributes  to  a 
comprehensive  evaluation  of  random  factors  measured  by  the  DE  grading 
criteria.  There  would  be  Increased  evaluation  of  altitude  malntenence, 
mission  timing,  and  route  adherence.  Equipment  serviceability,  which  weighs 
heavily  in  DE  computations,  can  be  more  acurately  measured  using  16  reports 
and  not  wing  aircrew  or  malntalnence  reports.  This  would  provide  a  more 
complete  profile  of  crew  force  capabilities. 

The  Soviet's  radio  detection  capability  Is  formidable.  In  order  to 
Increase  our  tactical  advantage,  the  author  recommends  flying  ORIs  using 
increased  communications  security  (COMSEC)  and  emission  control  (EMCON) 
procedures.  SACRs  3-1  and  51-52  provides  guidance  for  refueling  and  formation 
flying  in  a  simulated  EMCON  environment. 


Today  the  only  ORI  communication  restriction  Is  "crews  will  maintain 


radio  silence  after  the  HHCL*  <17:10-19).  The  training  event  defined  in  SACR 
51-52  by  the  computer  identifier  R-057  can  be  used  during  the  rendezvous  and 
refueling.  R-057  provides  for  one  radio  contact  15  minutes  prior  to  the  air 
refueling  control  time,  and  refueling  under  radio  silence  using  visual  signals 
<8:A2-15-A2-16) .  The  B-52  training  event  defined  in  SACR  51-52  by  the 
computer  identifier  P-109  simulates  the  restricted  communication  environment 
while  flying  bombers  in  formation.  The  bomber  formation  must  fly  using 
emission  restrictions  specified  in  SACR  3-1  for  the  entire  mission  including 
the  preflight  <8:A2-12).  Using  these  two  training  events  effectively  provides 
a  realistic  flying  scenario  by  simulating  a  wartime  EMCON  environment. 

The  author  recommends  flying  as  many  ORI  missions  at  night  as  possible  to 
challenge  the  aircrews  in  an  adverse  environment.  SAC  doesn't  fly  a  great 
deal  at  night.  The  author's  flying  logbook  shows  less  then  25  percent  of  his 
2000+  hours  in  the  B-52  is  nighttime.  Many  young  aircraft  commanders  have 
less  night  experience.  Air  refueling  at  night  is  a  challenge,  even  for  an 
experienced  aircraft  commander.  In  the  author's  experience  as  a  chief 
instructor  pilot,  night  air  refueling  is  a  potential  weak  area  for  young  B-52 
aircraft  commanders.  Visual  bombing  and  navigation  references  are  lost  at 
night,  simulating  a  cockpit  with  raised  thermal  protection  curtains  and 
fatigue  becomes  a  factor.  These  challenges  more  realistically  simulate  a 
wartime  environment  as  well  as  getting  young  aircrews  the  night  flying 
practice  they  need. 

The  author  recommends  IG  inflight  evaluators  record  weapon  release 
parameters  for  post  flight  comparison  to  technical  order  limits.  This  was 
suggested  by  15th  Air  Force's  Tactics  Office  <20:— >.  Weapons  are  delicate 
devices.  If  the  pilot  does  not  attain  release  parameters,  the  bomb  will  skew, 
collide  with  the  aircraft,  or  possibly  be  a  dud.  Aircraft  commanders  are 
usually  trying  to  center  the  steering  indicator  <FCI>  right  up  to  weapon 
release.  While  the  bomb  scoring  site  doesn't  know  If  your  aircraft  was  in  a 
bank  when  computing  the  bomb  score,  the  weapon  would  know.  Recording  bank, 
pitch,  and  altitude  at  weapon  release  will  allow  better  assessment  of  probable 
damage  from  that  weapon,  producing  a  better  estimate  of  actual  damage 
expectancy. 


The  author  recommends  that  the  Strategic  Air  Command  Implement  the 
recommendations  made  in  this  paper  while  continuing  to  explore  new  areas  to  be 
evaluated  inflight  to  produce  a  realistic  combat  environment.  If  expected 
fiscal  or  manpower  reductions  materialize,  the  author  recommends  implementing 
those  recommendations  not  affected  by  the  reductions  and  Implementing  the 
remainder  of  the  recommendations  as  soon  as  funding  becomes  available. 
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